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Abstract 

A conservative class of constraint satisfaction problems (cSPs) is 
a class for which membership is preserved under arbitrary domain re- 
ductions. Many well-known tractable classes of CSPs are conservative. 
It is well known that lexleader constraints may significantly reduce the 
number of solutions by excluding symmetric solutions of CSPs. We 
show that adding certain lexleader constraints to any instance of any 
conservative class of CSPs still allows us to find all solutions with a time 
which is polynomial between successive solutions. The time is poly- 
nomial in the total size of the instance and the additional lexleader 
constraints. It is well known that for complete symmetry breaking one 
may need an exponential number of lexleader constraints. However, 
in practice, the number of additional lexleader constraints is typically 
polynomial number in the size of the instance. For polynomially many 
lexleader constraints, we may in general not have complete symmetry 
breaking, but polynomially many lexleader constraints may provide 
practically useful symmetry breaking - and they sometimes exclude 
super-exponentially many solutions. We prove that for any instance 
from a conservative class, the time between finding successive solu- 
tions of the instance with polynomially many additional lexleader con- 
straints is polynomial even in the size of the instance without lexleader 
constraints. 
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1 Introduction 



In many applications of constraint satisfaction problems (cSPs), it often 
does not suffice to find only one solution, but the task is to find all so- 
lu tions. Examples range from problems of theoretical interest (see e.g. 



Distler and Kelseyl . l2009l : iBehle and Eisenbrandl. 120071: iBussieck and Lubbecke 



19981 ) to industrial applications (see e.g. Shlvakhter . 200?! : Ip and DillT 



1996 . 



and references therein). The task of finding all solutions of a CSP is ^P- 
complete, which is much harder than the already h a rd ta sk of finding one 
solution, which is AAP-complete Garev and Johnson ( 19791 ). Even for those 
classes where we can prove satisfiability in polynomial time, it may be MV- 
complete to decide whether a second solution exists. For example, consider 
the following class of CSPs. Given any CSP, we create a new value v and 
add it to the domain of each variable. Next we modify the constraints such 
that it allows one more assignment which assigns v to each variable. For this 
class of CSPs, the problem of finding one solution is polynomial. However, 
deciding whether the CSP has a second solution is A/''P-complete. Identify- 
ing classes of CSPs where we can find all solutions ir i an "acceptable time" 
has therefore received considerable attention ( see e.g. ISchnoor and Schnoori . 
200?! : iGohenl . l2004l : iGreco and Scarcellol . l2O10h . Acceptable time for finding 



all solutions formalises as follows. First, deciding the satisfiability of any in- 
stance of the class is polynomial. Finally, the class has an algorithm which, 
for any instance in the class, requires (1) polynomial time between start 
and the first solution, (2) polynomial time between successive solutions, and 
(3) polynomial time between the last solution and termination. The class is 
then said to have polynomial delay. 

Symmetries are a frequent feature of many practically important CSPs. 
Symmetries of a CSP are permutations of the variable- value assignments that 
preserve the constraints. The presence of symmetries indicates a redundancy 
in the CSP: symmetries partition the set of solutions into disjoint classes of 
symmetrically equivalent solutions. For symmetric CSPs, it is often enough 
to only find all equivalence classes of solutiori s as o pposed to finding all so- 



lutions (see e.g. IShlvakhtei] . l2007l : lip and Dili Il99fil . and references therein). 



Finding equivalence classes of solutions is particul arly interesti r ig if the sym- 
metr ies of the CSP are model-introduced (see e.g. ISmithl . l200fil : iFrisch et al.l. 



20051 ) . Finding all equivalence classes of symmetric solutions can be achieved 



by adding symmetry breaking constraints to the CSP, which exclude symmet- 
ric solutions while keeping at least one representative solution per equivalence 
class. In this paper, we consider adding symmetry breaking constraints to 
CSPs with polynomial delay and we study the complexity of the resulting 
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class. 



Main Contribution. We show t hat excluding symmet ric solutions by 
adding certain lexleader constraints ( Crawford et al. . 19961 ) preserves poly- 
nomial delay for many well-known tractable classes which are conservative. 
Here a class is conservative if it is closed un der arbitr a ry do main reductions, a 
notion which we formally define further on. iBulatovl (j2003l ) defines conserva- 
tive constraint languages, but our definition is more general. We prove that 
symmetry breaking is possible with a delay which is polynomial in the size of 
the instance and the size of the lexleader constraints. This includes complete 
symmetry breaking (with possibly super-exponentially many lexleader con- 
straints). However, if symmetry is broken by adding a polynomial number of 
lexleader constraints, then the delay is polynomial in the size of the instance 
only. Of course, such symmetry breaking may not be complete. 

This is a non-trivial result as we argue in the following. A nai've ap- 
proach would simply generate all solutions regardless of the lexleader con- 
straints and, after generation, reject solutions when they are symmetrically 
equivalent to an already found one. This approach would not preserve poly- 
nomial delay because the number of solutions rejected between successive 
symmetrically-distinct solutions can be super-exponential. A simple exam- 
ple shows this. Consider a CSP with n variables xi, X2, X3, . . . , x„. Each 
variable has domain {1,2,3, ... ,n} and we have one alldifferent constraint 
(decomp osed into binary 7^ con s traint s). A straight-forward extension of a 
result by Salamon and JeavonsI ( 2008 ) yields that this CSP has polynomial 
delay. The variable symmetries can be broken completely by adding a lin- 
ear number of c onstr aints Xi < Xj+i for i G {1, 2, . . . , n — Ijd Puget . 2005 : 
Cravland et~all . I2OO9I I. Without the symmetry breaking constraints, there 



are n! many solutions and with the symmetry breaking constraints there 
is 1 solution. The afore-mentioned generate-and-test approach would not 
have polynomial delay. Here, we prove that adding lexleader constraints 
nevertheless has the potential of finding all symmetrically distinct solutions 
of a CSP with polynomial delay even though we may sometimes exclude a 
super-exponential number of solutions with a polynomial number of lexleader 
constraints. In particular, we show that the delay of the CSP with lexleader 
constraints is polynomial even in the size of the instance without lexleader 
constraints, if we limit the number of lexleader constraints to a polynomial 
number. So, we can find all equivalence classes of solutions much faster with 
the help of lexleader constraints. 



3 



Structure of the Paper. The organisation of this paper is as fohows. 
In the first part, we consider lexleader constraint in isolation from other 
constraints and in the second part, we consider them in combination with 
problem-specific constraints. 

When considering lexleader constraints in isolation from problem-specific 
constraints, we start by introducing the class LEX of lexleader constraints on 
which we focus our attention in this paper in Section |4?T1 In the same section, 
we also consider CSPs whose constraints are in LEX. We shall refer to this 
class of CSPs as LCSP. We show that LCSP has polynomial delay. To the best 
of our knowledge, this result does not follow from known results on classes 
with polynomial delay. 

When considering lexleader constraints in combination with problem- 
specific constraints, we present an algorithm in Section [5] that finds all solu- 
tions of a CSP with lexleader constraints in LEX. We prove that the algorithm 
requires polynomially many calls to an oracle between finding subsequent so- 
lutions. This is our main result. Since the oracle runs in polynomial time for 
many well-known classes with polynomial delay, the preservation of polyno- 
mial delay under the addition of lexleader constraints follows directly. 

We start by introducing notation and discussing related work. 

2 Notation and Definitions 

A constraint satisfaction problem (cSP) is a triple C = {X,T),C), where 
X is the set of variables of C, every variable x has a domain T>{x) G P, 
and C is the set of constraints of C. Every constraint has an arity. The 
/c-ary constraint c is a pair {s,r), where s is a list of k variables xi, . . . ,Xk 
which is called the scope and r is called the relation of c. The relation is 
either given extensionally as a list of tuples that is allowed by the constraint 
(r C X • • • X T>[xk)) or intensionally as an expression. The arity of C 

is the maximum arity over all constraints in C. A CSP is called binary if all 
constraints are of arity 2 or lower. A literal is a (variable, value)-assignment. 
A partial assignment is a set of literals such that no variable appears twice. 
If a partial assignment is allowed by the constraints of C, then we call it a 
consistent assignment. A solution is a consistent assignment on all variables. 
If C has a solution, then we call C satisfiable and otherwise unsatisfiable. 
For a CSP with n variables, we denote an order -< on the variables either 
as a list [xi, X2, • • • , x„] or by stating xi -< X2 -< ■■■ -< x„. We call a 
partial assignment to the first variables with respect to ^ a consecutive 
partial assignment with respect to -<. We assume from here on, that the 
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domain of any variable x contains all integers between two values min and 
max, denoted by [min, max]. We refer to the smallest value that we can 
consistently assign to a variable as the lower hound of the variable. 

We call a constraint c = (s,r) generalised arc consistent (gac) if the 
following holds for all variables in s = [xi,X2, • • • For any G s and 

di G T>{xi) with i € {!,...,/;;}, there is a support, that is an assignment 
{(xi, di), (x2, (^2), • • • , {xk,dk)} G r such that dj G T){xj) for {1, . . . k} 3 j ^ 
i. If the constraint is binary and GAC, we simply say it is arc consistent. We 
can make a constraint GAC by removing those values from the domains of 
the variables in the scope of the constraint which do not have support. 

Let us define the size of a CSP. Given an instance {X,T>,C), we define 
the size of the extensional constraints first. We represent each constraint 
scope as a list of variables s C Af, and each constraint relation as a list of 
tuples over 'D{x), x (z s. The size of the extensional constraints is then 

log(I^|)+ ^ |s||rllog(M), 

{s,r)£C 

where M = maxx^x In this paper, we only consider one type of 

intensional constraint, which we introduce in Section [3l The size of an in- 
tensional constraint of this type is (n logdA'D). The size of a CSP with 
constraints in both extensional and intensional form is the sum of the size 
of the extensional constraints with the size of the intensional constraints. 

A class of CSPs is said to be tractable if we can decide the satisfiability 
of any instance in this class in a time that is polynomial in the size of the 
instance. A tractable class is said to have tractable search if for any member 
of the class that has a solution, we can find a solution in polynomial time. 
A tractable class of CSPs has polynomial delay if for any instance in the 
class, the following times are polynomial in the size of the instance: the 
time between the start and the first solution, the time between consecutive 
solutions and the time between the last solution, and the termination of the 
algorithm. 

We call a class of CSP s conservative if cla ss membership is preserved 
under domain reductions ( Cooper et al. . 201Cll ). A domain reduction of a 



domain V is either the replacement of D by P' C D together with adjust- 
ments of the constraints (e.g. removing tuples from constraint relations); or 
a domain reduction is the addition of a unary constraint that reduces the 
size of the domain of a variable. 

With any CSP C we associate a hypergraph called the micro structure 
complement (msc). The set of nodes of the MSC are the literals of C. A set 
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of nodes a = {{xi,di), . . . , (xfc, (ifc)} is a hyperedge in the MSG either if A; = 2 
and xi = X2 or if a is forbidden by a constraint of C. An automorphism of 
a hypergraph is a bijecti on on the set of no des that preserves hyperedges. 
A constraint symmetry ( Cohen et al. . 20061 ) of C is an automorphism of 
the MSG of C. A variable constraint symmetry is a constraint symmetry 4> 
such that (j){x,d) = {'ip{x),d) for a suitable chosen bijective map ip on the 
variables of C. Constraint symmetries form a group and partition the set 
of solutions of a GSP into disjoint orbits, which are equivalence classes of 
symmetric solutions. 



3 Related Work 

Apart from constraint symmetries, other forms of symmetries exist, most 
notably solution symmetries. Solution symmetries are a supergroup of con- 
straint symmetries and our results hold for solution symmetries as well. 
However, solution symmetries are typically very hard to find and, in prac- 



tice, Constraint Programmers consider constraint symmetries (ICohen et al 



2006l l. Two frequent constraint symmetries are variable constraint sym- 



metries and value constraint symmetries. A value constraint symmetry 
(f) : X xD ^ X xD is a, constraint symmetry such that (p{x, d) = {x, ip{d)) for 
a suitably chosen bijective map ip : D ^ D on the values. We can ensure in 
polynomial time that in a search tree as constructed by a backtrack algorithin 



no tw o nodes are symmetric via a value symmetry (|Ronev-Dougal et al 



20041 ) . Hence, results on the preservation of polynomial delay naturally hold 
for problems with value constraint symmetry breaking. However, for variable 
constraint symmetries, which we consider here, results on the preservation 
of polynomial delay are new. 

In this paper, we consider adding symmetry breaking constraints to a 
GSP before solving the GSP. This is usually referred to as static symmetry 
breaking. Other symmetry breaking m ethods add symin etry breaking con- 



straints during search dynamically. See ( Gent et al. . 20061 ) for an overview of 



general approaches to sym metry b reakin g in constraint programming. For 
static symmetry breaking, Puget ( 19931 ) presented an abstract framework 



and provided a basic symmetry breaking constraint. I Crawford et al. (Il996h 



then introduced general symmetry breaking constraints in the context of 
Boolean satisfiability. We consider static symmetry breaking for variable 
constraint symmetries. A variable constraint symmetry a of a GSP with n 
variables be thought of permutation of the index set 

{l,2,...,n}. Let us choose an order on the variables, say [xi,X2, ■■■^x^ 
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A lexleader constraint ( Crawford et al. . 19961 ) enforces that any consistent 
assignment on the variables [xi, X2, does not lexicographically exceed 
its symmetric image under a. In formula, the lexleader constraint is 

[xi, X2, • • • , Xn] <lex ■, X(t{2)i • • • ) ^a{n)\ ■ 

We represent lexleader constraints intensionally because their extensional 
representation may quickly lead to exponential space requirement. We refer 
to the variables on the left hand side of <iex as LHS and to the variables 
on the right hand side as RHS. For lexicographic comparison, we also need 
an order on the domains of the variables. In this paper, we shall use the 
natural order on the integers. We refer to the variable order in the lexleader 
constraint and the order on the domains as the orders of the lexleader con- 
straints. Lex leader constrain t s pres erve at least one solution from every orbit 
of solutions ( Crawford et al. . 19961 ). We call this property partial symmetry 
breaking. If we introduce a lexleader co nstraint for every symm etry, then we 
preserve exactly one solution per orbit ( Crawford et al. . 19961 ). We call this 
property complete symmetry breaking. Unfortunately, the number of sym- 
metries can be super-exponential in the number of variables. This is why 
practitioners typically do not add all possible lexleader constraints to a CSP. 
Next, we discuss two approaches to simplify lexleader constraints. 

There are two main approaches to reducing the number and arity of 
lexleader constraints which we present next. The first approach is partial 
symmetry breaking, that is, we o nly construct lex leader constraints for a 



subset of the symmetries (see e.g. Gent et al. . 20061 ). The second approach 



consists of reduction rules that simplify a set of lexleader constraints while 
preserving their logical equivalence. 

An example of partial symmetry breaking is any set of lexleader con- 
straints based on transpositions. A transposition is a permutation that swaps 
two variables while having no effect on the other variables. There are at most 
(2) transpositions of n variables, although the symmetry group can be much 
larger: for instance if every transposition is a symmetry, then every permu- 
tation of the variables is a symmetry, and the size of the group is n!. A 
polynomially-sized set of lexleader constraints does not always provide com- 
plete symmetry breaking and often only removes a polynomial number of 
solutions. However, in some cases, a polynomially-sized set of lexleader con- 
straints does remove an exponential number of solutions: whenever the sym- 
metry group contains all transpositions, adding lexleader c onstraints based 



on tr a nsposit i ons b reak the symmetries completely (see e.g. iGravland et al. 
2OO9I : IPugetl . I2OO5I ) In many cases, partial symmetry breaking may be 
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a good alternative from a user's point o f view (see e.g. IShlvakhteij . 120071 : 
Flener et all I2OO2I : lOravland et"al1 . l2009l 'l . 

We briefly discuss an example of a reduction rul e whic h reduces the ar- 
ity of lexleader constraints (see e.g. iGravland et al.l . [20091). In Section [4.H 
we shall consider a family of lexleader constraints which subsumes lexleader 
constraints that are reduced with this rule. Suppose that we are not de- 
riving lexleader constraints for all symmetries, but only for symmetries of 
a CSP with n variables xi, . . . ,x„ that can be written as a composition of 
disjoint transpositions. The advantage of a lexleader constraint based on a 
composition of disjoint transpositions a is that we can easily simplify the 
resulting lexleader constraints to give lexleader constraints without repeated 
variables, as follows. 

o If a{i) = i, then Xj can be dropped from both sides of the lexleader 
constraint; 

o For indices a and b with a < 6, if o" swaps the indices a and b, then 
the constraint will first have Xa on the LHS, paired with xi, on the RHS, 
and then later x^, on the LHS and Xa on the RHS. We can drop the 
second pair. If we have Xi < x^f^-^ for some i such that 1 < i < 5, then 
Xa < Xh and the second pair has no effect because the assignment on LHS 
is already lexicographically less than the assignment on RHS. If = Xo-(j) 
for 1 < i < b, then in particular Xa = Xh and again, the second pair has 
no effect. 

This is an example of a reduction rule for lexleader constraints. 

We consider adding symni e try b reaking constraints to classes of CSPs 
with polynomial delay. ICohenI ()2004l ) shows that certain classes defined by 
restrictions on the constraint relations have polynom ial delay via an algo- 



rithm which we modify for our purposes further on. ISchnoor and Schnoor 
(|2007l ) provide extensions of Co hen's results and present n ew enumeration 
schemes for finding all solutions. Greco and Scarcello ( 2010l ) prove the poly- 
nomial delay of a wide range of classes defined by restrictions on constraint 
scopes. However, none of their work considers symmetry breaking. We are 
not aware of work on problems with polynomial delay with added symmetry 
breaking constraints. 

To the best of our knowledge, no theoretical results on the effect of sym- 
metry breaking on tractability or polynomial delay are known. Empirical 
results do not provide a clear indication on the effect of symmetry breaking 
on tractability. For example, there is ab undant evidence of the practical 



usefulness of symmetry breaking (see e.g. ICent et all . I2OO6I ). However 



ev- 



idence also shows that symmetry breaking may be harmful sometimes (see 
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Gent et al. 


5 


2002 




Prestwich . 



2008h . 



4 CsPs Consisting of Lexleader Constraints 

This section studies lexleader constraints in isolation from problem-specific 
constraints. We introduce LCSP as a class of CSPs that has only lexleader 
constraints of a certain form and we show that LCSP has polynomial delay. 
Our results on combining lexleader constraints with other constraints build 
on this result. 

4.1 Finding All Solutions 

In this section, we prove that for lexleader constraints of a certain form, we 
can find all solutions of a CSP whose constraints consist of these lexleader 
constraints with failure-free search. We use this result to show that the class 
of CSPs with these lexleader constraints has polynomial delay. First, we 
define the class of lexleader constraints that we need for the exposition of 
our results. 

Consider a CSP with n variables ordered as [xi,X2, ...,Xn]- Let us define 
the subset of lexleader constraints that we want to study in the following. 

Definition 1 (lex). Let X be a set of variables ordered as [xi,X2, A 
family of lexleader constraints L on X is in LEX if each lexleader constraint 
in L has the following characteristics. 

o The constraint is of the form 

[Xf-^ , Xf2 ) ) • • • ) —lex i^ri ) j : ■ ■ ■ j X^f,] ■ (1) 

Often, we consider variables in LHS and RHS with the same sub-index i 
and refer to them as a pair {xi-,Xr.i) with respect to Constraint ([1]). We 
omit references to the lexleader constraint whenever it is clear what we 
mean. 

o For each j with 1 < j < k, we have ij < H-j+i ■ 
o For each j with i < j < k, we have £j < rj . 

Lexleader constraints for compositions of disjoint transpositions can be 
reduced (with the reduction rule discussed in Section [3]) such that they are 
contained in LEX. Let us define a class of CSPs that we want to study in the 
following. 

Definition 2 (lcsp). We denote the class of CSPs consisting of constraints 
in LEX by LCSP. 
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The following theorem explains the effect of maintaining GAC during 
search for solutions of CSPs in LCSP with a chronological backtrack algorithm 
that maintains GAC. 

Theorem 3. For any CSP in LCSP, where we search for a solution with a 

chronological backtrack search with variable and value orders in the search 
being the same as in the lexleader constraints, maintaining GAC may only 
result in an increase in the lower bound on the unassigned variables. 

Proof. Suppose that at some point in the search the variables xi,X2, . . . ,Xi 
have been assigned during search and the remainder have not. We show in 
the following that maintaining GAC may only remove the smallest values in 
the domains of the unassigned variables. 

We consider an unassigned variable. Let us first consider the case, where 
an unassigned variable occurs on the RHS of some constraint, paired with a 
LHS variable that is already assigned. We refer to the RHS variable as 
and the LHS variable as x^., where x^. has been assigned the value a, for 
some value min < a < max; < i and rj > i. Let us consider the effect of 
constraint propagation on the domain of such a variable Xrj- First, all the 
preceding variables on both sides of the constraint may have been assigned 
such that the LHS and RHS variable in each pair are equal. In that case, 
we have Xr^ > a. Next, a pair of variables in the same constraint could 
exist that appears behind {x£. , Xrj ) in the order and the pair is such that the 
RHS variable must have a smaller value than the corresponding LHS variable. 
The pair {x£ , Xr^ ) could then be the only pair of variables that will allow 
the constraint to be satisfied, by having X£^ < Xr^, resulting in Xrj > a + 1. 
(Note that because GAC is maintained on this constraint, it must be possible 
to do this. We must have Xi. < Xr^, so if X£. is assigned the value max, 
then the domain of Xr^ becomes max and it would not be possible to assign 
the variables that appear later in the order in the constraint in a way that 
forces Xrj > X£..) Hence, if a variable occurs on the RHS of a constraint, 
propagating the constraint results in an increase of the lower bound. 

Next, let us consider the case where an unassigned variable Xi- appears 
on the LHS of some constraint. We have ij > i. If x^. appears on the RHS of a 
constraints, its lower bound may have increased as argued before. So in each 
constraint, when the LHS variables have not yet been assigned, any variable 
appearing later in the order either in LHS or RHS may have had its lower 
bound increased as a result of enforcing GAC on other constraints. In the 
extreme case, enforcing GAC on another constraint may result in X£ . = max. 
Because of the previous domain reductions we must have X(,. < 
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and every later variable on both sides of the constraint must be instantiated 
to max. 

To summarise, the effect of maintaining GAC on a set of lexleader con- 
straints on the domain of any of the variables Xj+i,Xj+2, can only be 
that the lower bound is increased. In particular the value max is not re- 
moved. □ 

Corollary 4. For any CSP in LCSP, we can find all solutions failure-free, if 
we maintain GAC on the lexleader constraints during search. 

Proof. In a chronological backtrack algorithm, we choose the variable and 
value order in the search as the same as in the lexleader constraints. In 
light of Theorem [3l we only have to prove that we can extend any consistent 
assignment to a solution. This follows from the fact that value max is not 
removed by maintaining GAC: in a consistent partial assignment as found by 
the chronological backtrack algorithm, we can assign max to all unassigned 
variables which is consistent with all lexleader constraints. □ 

Theorem [3] shows that when assigning values to the variables in an order 
that is compatible with the lexleader constraints, maintaining GAC only re- 
moves values from the lower end of any domain. If different orders are used 
for search and for constructing the lexleader constraints, then failures may 
occur, as we show in the following example. 

Example 5. Suppose all variables in the CSP have domain [0, 1] and the 
lexleader constraints constructed for order [xi, X2, ■ ■ ■ , xq] are 



Note that these constraints are in LEX. Suppose we make the assignments: 
xi = 0, X2 = 0, X3 = 1 and X/j^ = 0. Since xi = X2, it follows from ([2]) 
that X5 < xq. Since x^ > X4, it follows from ([3]) that either x^ > xi = 
or xq > X2 = 0. Enforcing GAC on each constraint reduces the domain of 
neither X5 nor xq. 

Following Theorem we should assign X5 next. Either value in the 
domain of x^ will lead to a solution. In each case the value will be removed 
from the domain of xq. One can confirm easily that we can find all solutions 
failure-free, if we use the orders as suggested in Theorem El 



[X1,X5\ <lex[x2,Xe] 



(2) 



and 



[xi,X2,X3\ <lex[x5,X6,X4] . 



(3) 
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Consider using an order that is not in accordance with the order in the 
lexleader constraints and hence not fulfilling the condition of Theorem [3' 
instead of assigning x^, we try to assign a value to xq. If we try to assign 
the value 0, the assignment fails after GAC and we need to backtrack. 



This example shows that assigning the variables in a different order than 
for the lexleader constraints may lead to failures during search. However, 
the example confirms that all solutions can be found without failing if the 
correct variable solutions can be found without failing if the correct variable 
and value orders are followed. Empirically, it has been known for a long 
time that le xleader con s traint s may increase the run-time as opposed to 



reducing it (jGent et al.l . |2002| ) . Also well-known is the advice to use the 
sam e orders for search and for the construction of lexleader constraints (see 
e.g. iGent et all . I2OO6I I. Theorem [3] gives further theoretical justifications for 



using the same orders. 

The following result is the main result of this section. 

Theorem 6. LCSP has polynomial delay. 

Proof. Consider a chronological backtrack algorithm with the variable and 
value order of the lexleader constraints. We have to prove that the time from 
the start of the chronological backtrack algorithm to the first solution, the 
time between consecutive solutions and the time between the last solution 
and termination of the algorithm is polynomial. 

The time from start to the first solution is polynomial, because assigning 
min to every variable leads to (the first) solution and the time from last 
solution to termination is also polynomial, because assigning max to every 
variable is allowed (and the last solution). 

Hence, we only prove that the time between consecutive solutions is 
polynomial. Consider a node in the search tree and the set of lexleader 
constraints . We can enfor ce GAC on a single lexleader constraints in polyno- 



mial time (iKiziltanl . l2004l ) and we can also ensure in polynomial time that 



each lexleader constraints is GAC0 Corollary S guarantees that the current 
subtree contains a solution which we can then find in polynomial time. □ 



We note that Theorem [6] also holds for the practically important case 
where there is only a polynomial number (in the variables) of lexleader con- 
straints in LCSP. We further remark that for sets of lexleader constraints 

^This is in contrast to ac hieving; GAC on a conj unction of lexleader constraints for which 
enforcing GAC is A/'P-hard (jBessiere et al.l . [200I I. 
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in LCSP that have super-exponential size in the number of the variables, a 
simple generate-and-test approach is enough to prove Theorem [6j 

In the next section, we prove stronger results on combining lexleader 
constraints in LEX with problem-specific constraints. 



5 Adding Lexleader Constraints to Symmetric CsPs 



In the previous section, we considered CSPs with lexleader constraints in 
isolation from problem-specific constraints. In practice, we consider CSPs 
with lexleader constraints in combination with other constraints. This is the 
setting of this section. 

Before we start, we state two assumptions. Our first assumption is that 
we ignore the problem of finding symmetries. In many cases, the symmetries 
are provided by t he user through their insight into a specific problem (see 
Gent et all . boOfil l. For automated symmetry detection, f inding symmetries 
is as hard as the graph isomorphism problem (ICrawfordl. Il992h who s e com - 
plexity status is a long-standing open problem ( Garev and Johnson . 19791 ). 



It is well-solved in practice (see e.g. iMcKavl . Il98lh . Our second assump 



tion is that we ignore the complexity of reducing lexleader constraints such 
that they fit the class LEX. For example, lexleader constraints for symme- 
tries that are disjoint compositions of transpositions can easily be reduced. 
Note, that it may not always be possible to reduce lexleader constraints such 
that they fit into LCSP, however, in practice, disjoint transp ositions occur 



frequ ently (e.g. row-and column symmetries in matrix models iFlener et al. 
2OO2I ). 

For this section, we assume the existence of an oracle, that tells us for 
any given CSP with an order on the variables whether a consecutive partial 
assignment (with respect to this order) can be extended to a solution. We 
simply refer to this as the oracle. We provide Algorithm [1] that finds all 
solutions to any CSP where we have added lexleader constraint in LEX. The 
solutions that Algorithm [1] outputs are the solutions of the CSP modulo the 
lexleader constraints: these are usually much fewer solutions than the CSPs 
without lexleader constraints has. In Theorem [7] we prove that Algorithm [T] 
works with polynomial delay in calls to the oracle. We call this polynomial 
oracle- delay. Since the oracle can decide the satisfiability of any CSP easily, 
we do not further discuss the case where the input CSP is unsatisfiable. 

In the following, we describe Algorithm [TJ Algorithm [1] is a chronologica l 
backtrack search for all solutions similar to algorithm PolEnum (jCohenl . |2004| ) . 
We assume that every variable Xi has a domain Di that we reduce during 
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search by maintaining GAC. Maintaining GAG is the main difference between 
our algorithm and PolEnum. We assume that domains are backtrackable, i.e., 
domains restore themselves upon backtracking. Given a GSP C, we fix an 
order in Step [1] which we use both for search and the lexleader constraints. In 
order to facilitate exposition, we say that this step constructs a second GSP 
Clex which consists of the same variables and domains as C. The constraints 
of Clex are in LEX for the specified order and so, Clex £ LGSP. We search 
for all solutions in Clex with a chronological backtrack search with a fixed 
variable and value order as in Corollary [4] maintaining GAC on the lexleader 
constraints fStep[TO|). The assignment step of the algorithm is in two stages. 
First, we tentatively assign the smallest allowed value to the next variable 
in the search order in Clex and propagate. This step will always succeed. 
Next, we turn to the oracle in Step [TT] and ask whether the current partial 
assignment can be extended to a solution in C. The oracle takes all domain 
reductions through enforcing GAG into account. If the oracle confirms the 
existence of a solution in C, we consider the next variable in the search order; 
if no solution exists, we consider the next value, removing the current value 
from the domain of the variable (Step [THl) . We propagate the effect of the 
oracle call using Clex- We backtrack in Step [21] and restore the domains to 
the state just before the undone assignment happened. 

The following result shows that Algorithm [1] finds solutions with polyno- 
mial oracle-delay. 

Theorem 7. Algorithm{l\ finds solutions with polynomial oracle-delay. 

Proof. Given a GSP C as input to the algorithm, let the GSP Clex consist of 
the variables and domains of C and lexleader constraints in LEX for the input 
symmetries. We assign values to variables in such a way that the only effect 
that enforcing GAG on the lexleader constraints in Clex has, is a raise in the 
lower bound of the unassigned variables. This is analogous to Theorem [3l 
As opposed to the proof of Gorollary 31 however, we cannot simply set all 
remaining variables to max to have a guaranteed solution for the branch of 
the search tree (as this could be forbidden by the constraints in C). We have 
to prove that the current assignment on the first i variables can be extended 
to a solution in C that also satisfies the constraints in Clex- For the sake 
of contradiction, we assume that the current assignment cannot be extended 
to a solution that satisfies all constraints in Clex- 

The oracle guarantees that the current assignment can be extended to a 
solution S of C. If S is forbidden by a constraint in Clex, then a symmetry 
(j) exists with (p{S) <iex S. So, (piS) has a strictly smaller value v on the 
first position where S and (j){S) differ, say at position j. If j > i, then there 
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Input: CSP C with n variables, each variables has domain V and a 
set S of symmetries of C such that the corresponding 
lexleader constraints for S are in LEX ; 

Output: All symmetrically distinct solutions of C with respect to S 

1 Fix search order [xi,X2-, ■ ■ ■ , x„] ; 

2 Construct lexleader constraints in LEX with order [xi, .X2, . . . , x^] ; 

3 For each variable Xi define a backtrackable domain T>i = T> ; 

4 Define a partial assignment Assign = ; 

5 z 1 ; 

6 while i > do 

7 if 7^ then 

8 d •<— min(Pj) ; 

9 Assign ■<— Assign U {(xj, d)} ; 

10 Enforce GAC on lexleader constraints ; 

11 if Assign extends to a solution in C then 

12 if i = n then 

13 I Print Assign as the next solution ; 

14 else 

15 |_ i z + 1 ; 

16 else 

17 1^ Assign ^ Assign \ {last assignment to Xi} ; 

18 Vi^Vi\ {d} ; 

19 else 

// backtrack 

20 Vi^V ; 

21 Assign Assign \ {last assignment to Xi} ; 

22 i z — 1 ; 

Algorithm 1: Chronological Backtrack for Finding All Solutions. 
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is a solution in the current branch, which we assumed to be impossible. So, 
j < i. However, value v for variable j was removed by enforcing GAC on 
the lexleader constraint for symmetry (p, when finding solution S, because 
we always choose the smallest available value. Hence, the oracle should have 
indicated that the current assignment cannot be extended to a solution on 
the reduced domains. 

This proves that for the current branch of the search tree, we can surely 
find a solution. Hence, we can use the same argument as in the proof of 
Theorem [6] to show that the time between finding consecutive solutions and 
the time to find the first solution is polynomial. To terminate the proof, we 
only have to show that the time between the last solution and the termination 
of the algorithm requires a polynomial number of calls to the oracle. We have 
already shown that whenever the oracle confirms that a solution still exists 
for the current branch, a solution in this branch exists that is allowed by the 
lexleader constraints as well. So, in the worst case, we have to backtrack 
to the last assigned variable and call the oracle for all remaining values for 
the variable until we have reached the first variable. Hence, a polynomial 
number of calls to the oracle suffices to terminate the algorithm. □ 

In the remainder of this section, we use Algorithm [T] and Theorem [7] to 
show that for some tractable classes of CSPs, we can find all solutions with 
polynomial delay, even if we add lexleader constraints in LEX. 

First, we introduce some more notation. Let P be a class of CSPs. The 
class Plex then consists of instances C which we can decompose into two in- 
stances Cp and Clex such that Cp P and Clex G LCSP with the property 
that the constraints in Clex are constructed for a subset of the symmetries 
of Cp. We use the natural order on the domains as a value order for con- 
structing the lexleader constraints and we adapt the variable order in the 
lexleader constraints, depending on Cp. We note that an instance C has at 
least one solution per orbit of solutions in Cp because Clex only contains 
lexleader constraints for (some of) the symmetries of Cp. 

We note that some tractable classes are conservative, i.e. closed under 
arbitrary domain reductions. So, the oracle surely runs in polynomial time. 
For conservative classes Theorem [7] shows that adding lexleader constraints 
in LEX preserves polynomial delay. This is our main contribution, which we 
now state explicitly. 

Corollary 8. Let P be a class of CSPs with polynomial delay. If P is con- 
servative, then Plex has polynomial delay. 
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If we limit the number of lexleader constraints to be polynomial in the 
size of the input CSP, then we have shown the following. 

Corollary 9. Let P be a class of CSP s with polynomial delay. If P is con- 
servative and if the size of Plex is bounded by a polynomial in the size of P, 
then Plex has a delay that is polynomial in the size of P. 



If we employ lexleader constraints for all appropriate symmetries, which 
may be a possibly super-exponential number, then Corollary [8] states that 
polynomial delay is guaranteed in the size of the CSP and the size of the 
(possibly super-exponentially many) lexleader constraints. Corollary [9] is 
geared towards practical needs. In practice, we typically limit the number 
of lexleader constraints to be at most polynomial by only selecting a subset 
of the symmetries. Corollary [9] then guarantees that polynomial delay is 
preserved in the size of the original instance - this is remarkable because a 
polynomial sized set of lexleader constraints may exclude super-exponentially 
many solutions. 

Many well-known classes of CSPs with polynomial delay are conserva- 
tive. E xamples includ e CSPs with constraints in a tractabl e conservative lan- 



guag e 



(jBulatovl - liooi ). CSPs with a perfect mic rostructure (ISalamon and JeavonsI 



20081 ) , CSPs with the broken triangle pr opertv (ICoooer et all . l2010l ) and CSPs 



with fixed bounded degree of cyclicity (jJeavons et al.l . 1 19941 ) . 



6 Conclusion 

We have shown that for a conservative and tractable class of CSPs P, we can 
still find all solutions with polynomial delay after adding lexleader constraints 
in the class LEX to each instance in P. If we only add a polynomial number 
of certain lexleader constraints to the instances in P, we have shown that 
the delay is polynomial also in the size of P. Our results mean that adding 
certain lexleader constraints enables us to find all symmetrically distinct 
solutions in less time. 

Our results highlight the necessity to use the same orders for search and 
for lexicographic ordering. This has been noticed empirically before and our 
results provide a theoretical support for this. 

Acknowledgements. The first author thanks Dave Cohen and Andras 
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